Deep learning?based multi?modal computing with feature disentanglement for MRI image synthesis
نویسندگان
چکیده
Purpose: Different Magnetic resonance imaging (MRI) modalities of the same anatomical structure are required to present different pathological information from physical level for diagnostic needs. However, it is often difficult obtain full-sequence MRI images patients owing limitations such as time consumption and high cost. The purpose this work develop an algorithm target sequences prediction with accuracy, provide more clinical diagnosis. Methods: We propose a deep learning based multi-modal computing model synthesis feature disentanglement strategy. To take full advantage complementary provided by modalities, utilized input. Notably, proposed approach decomposes each input modality into modality-invariant space shared modality-specific specific information, so that features extracted separately effectively process data. Subsequently, both them fused through adaptive instance normalization (AdaIN) layer in decoder. In addition, address lack test phase, local fusion (LAF) module adopted generate modality-like pseudo-target similar ground truth. Results: evaluate performance, we verify our method on BRATS2015 dataset 164 subjects. experimental results demonstrate significantly outperforms benchmark other state-of-the-art medical image methods quantitative qualitative measures. Compared pix2pixGANs method, PSNR improves 23.68 24.8. Conclusion: could be effective sequences, useful diagnosis treatment.
منابع مشابه
Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis
For the last decade, it has been shown that neuroimaging can be a potential tool for the diagnosis of Alzheimer's Disease (AD) and its prodromal stage, Mild Cognitive Impairment (MCI), and also fusion of different modalities can further provide the complementary information to enhance diagnostic accuracy. Here, we focus on the problems of both feature representation and fusion of multimodal inf...
متن کاملA Bayesian approach for image denoising in MRI
Magnetic Resonance Imaging (MRI) is a notable medical imaging technique that is based on Nuclear Magnetic Resonance (NMR). MRI is a safe imaging method with high contrast between soft tissues, which made it the most popular imaging technique in clinical applications. MR Imagechr('39')s visual quality plays a vital role in medical diagnostics that can be severely corrupted by existing noise duri...
متن کاملDeep Learning in Image Computing: An Overview
Deep learning is a growing trend in computing. It is an improvement to artificial neural network. Deep Neural Networks are used in image classification, detection and segmentation. In this paper, an overview is carried out about the usage of deep neural network in various areas of image computing including image quality assessment, document imaging, object recognition, medical imaging, content ...
متن کاملDeep sketch feature for cross-domain image retrieval
Deep learning has been proven be very effective for various image recognition tasks, e.g., image classification, semantic segmentation, image retrieval, shape classification etc. However, existing works on deep learning for image recognition mainly focus on either natural image data or binary shape data. In this paper, we show that deep convolutional neural networks (DCNN) is also suitable for ...
متن کاملDeep Graphical Feature Learning for Face Sketch Synthesis
The exemplar-based face sketch synthesis method generally contains two steps: neighbor selection and reconstruction weight representation. Pixel intensities are widely used as features by most of the existing exemplar-based methods, which lacks of representation ability and robustness to light variations and clutter backgrounds. We present a novel face sketch synthesis method combining generati...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Medical Physics
سال: 2021
ISSN: ['2473-4209', '1522-8541', '0094-2405']
DOI: https://doi.org/10.1002/mp.14929